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Amendments to the Claims 
This listing of claims replaces all prior versions and listings of claims in the application. 

Listing of Claims 

1-108. (Cancelled) 

109. (Currently Amended) A method, comprising: 

identifying receiving one or more advertisements that are available for presentation with 
a document; 

receivin g, by at least one processor, initial advertisement performance information for the 
on e or mor e advertisements , the advertisement performance information for each advertisement 
specifying a measure of performance computed based on previous presentations of the 
advertisement ; 

identifyin g, by at least one processor, one or more content concepts [[of a]] to which the 
document is relevant, concepts being identified based on content of the document ; 

receiving, by at least one processor and for each content identified concept [[of]] for the 
document, content concept performance information representing an aggregate performance of 
advertisements that were presented with the document and corresponding to the concept ; 

d e t e rmining, for each content concept of the document, at least one of the one or more 
advertisements associated with the content concept; 

modifying, using b y at least one processor, the initial advertisement performance 
information for an at least one of the one or more advertisements]] using the determined 
content concept performance information fo r the content an identified concept associated with 
corresponding to the at least one of the one or more advertisement[[s]]; and 

forwarding, based on the modified advertisement performance information, at least one 
of the advertisements. 
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1 1 0. (Currently Amended) The method of claim 1 09, wherein the advertisement 
performance information includes one or more of selection information and impression 
information for the one or mor e advertisements. 

111. (Previously Presented) The method of claim 1 09, wherein the document is a Web 
page identified by a URL. 

112. (Currently Amended) The method of claim 1 09, wherein modifying the initial 
advertisement performance information for an the at l e ast one of the one or more 
advertisement^ s]] comprises: 

id e ntifying selecting a n identified content concept as sociated with the at least o n e o f the 
on e or more to which the advertisementfrsll corresponds ; and 

receiving cont e nt concept performance information associat e d with the cont e nt for the 
selected concept , the content performance information being computed based on performance of 
other advertisements that were presented with the document and correspond to the selected 
concept, associat e d with the at least one of th e one or more advertisements. 

113. (Currently Amended) The method of claim 1 09, wherein receiving, for each 
cont e nt identified concept [[of]] for the document, the content concept performance information 
comprises determining, for each eenten Hdentified concept for_[[of ]]the document, content 
concept performance information using [[the]] document specific advertisement performance 
information for the identified advertisements at least one of the one or more advertisements 
associated with the content corresponding to the identified concept. 

1 14. (Currently Amended) The method of claim 1 13, wherein further comprising : 
determining, for each content concept of the document, the at least one of the one or more 

advertisements associated with the content concept comprises determining, for a content each 
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identified concept [[of]] for the document, document specific advertisement performance 
information for a first advertisement and a second advertisemen t associated with the content 

determining, for each cont e nt identified concept [[of]] for the document, content concept 
performance information using the document specific advertisement performance information 
for the at least one of th e one or more advertisements associated with the content concept 
comprises processing, for the content concept of the document, the advertisement performance 
information for th e first advertisement and the second advertisement associated content 
corresponding to the identified concept. 

115. (Currently Amended) The method of claim 1 09, wherein the concept performance 
information for a concept includes one or more of selection information and impression 
information for advertisements presented with the document and corresponding to the on e or 
mor e concept[[s]]. 

116. (Currently Amended) The method of claim 109, further comprising determining a 
confidence measure for the advertisement performance information , the confidence measure 
representing a confidence level for the advertisement performance information relative to other 
advertisement performance information . 

117. (Previously Presented) The method of claim 116, wherein determining the 
confidence measure for the advertisement performance information comprises determining a 
confidence measure for the advertisement performance information based on one or more of the 
age of data included in the advertisement performance information and the amount of the data 
included in the advertisement performance information. 



118. (Currently Amended) The method of claim 1 09, wherein the at least one of the 
t»efe advertisement[[s]] for which the initial advertisement performance information is 
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modified is included with the same as the forwarded at least on e of the one or more 
advertisements. 

119. (Currently Amended) The method of claim 1 09, wherein the at least one of the 



120. (Currently Amended) The method of claim 1 09, wherein forwarding, based on 
the modified advertisement performance information, [[the]] at least one of the one or more 
advertisements comprises: 

comparing the modified advertisement performance information for an 
advertisement to a threshold; 

determining that the modified advertisement performance information exceeds the 

threshold; and 

forwarding the advertisement based on the modified advertisement performance 
information exceeding the threshold . 

121. (Currently Amended) The method of claim 1 09, wherein: 

identifying the one or more content concepts [[of]] to which the document is relevant 
comprises identifying a first content concept and a second content concept [[of]] to which the 
document is relevant ; and 

the method further comprising determining, for e ach content concept of the document, 
the at least one of the one or more adv e rtisements associated with the content concept comprises 
determining that one of the one or mor e an advertisement[[s]] is associated with both the 




-the first content concept and the second content concept [[of]]for the document. 



1 22. (Currently Amended) The method of claim 1 09, wherein: 
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receiving the initial advertisement performance information for the one or more 
advertisements comprises receiving advertisement targeting information for the one or more 
advertisements; and 

receiving the content concept performance information comprises receiving cont e nt 
concept targeting performance information representing an aggregate performance of 
advertisements targeted according to the advertisement targeting information that were presented 
with the document based on the advertisement targeting information . 

123. (Currently Amended) The method of claim 109, further comprising: 
identifying a first advertisement of the one or mor e advertisement that does not have 

initial advertisement performance information; 

determining that at least one of the one or mor e content identified concepts [[ofJ]for the 
document associat e d with correspond to the first advertisement; 

receiving cont e nt concept performance information for the at least one of the one or more 
cont e nt identified concepts associated with corresponding to the first advertisement; and 

determining, based on the received content concept information for the at least one of the 
on e or mor e cont e nt identified concepts associated with the first advertisement, estimated 
advertisement performance information for the first advertisement. 

124. (Currently Amended) The method of claim 123, wherein determining the 
estimated advertisement performance information for the first advertisement comprises 
determining a weighted-sum of the content concept information for the at least one of the one or 
more content identified concepts associated with corresponding to the first advertisement. 

125. (Currently Amended) An apparatus comprising one or more processors connected 
to a storage device, wherein the one or more processors are configured to: 

identify receive one or more advertisements that are available for presentation with a 



document ; 



Applicant : Yingwei Claire Cui et al. Attorney's Docket No.: 16113-0760001 

Serial No. : 10/649,585 
Filed : August 27, 2003 
Page : 7 of 20 

receive initial advertisement performance information for the on e or more 
advertisements , the advertisement performance information for each advertisement specifying a 
measure of performance computed based on previous presentations of the advertisement ; 

identify one or more content concepts [[of a]] to which the document is relevant, concepts 
being identified based on content of the document ; 

receive, for each identified content concept [[of ]]for the document, content concept 
performance information representing an aggregate performance of advertisements that were 
presented with the document and corresponding to the concept ; 

determine, for each content concept of the document, at least one of the one or more 
advertisements associated with the content concept; 

modify the initial advertisement performance information for at least one of th e one or 
mor e an advertisement[[s]] using the d e t e rmined cont e nt concept performance information for 
the content an identified concept associated with corresponding to the at least one of th e on e or 
mere-advertisernentffs]]; and 

forward, based on the modified advertisement performance information, at least one of 
the on e or more advertisements. 

126. (Currently Amended) The apparatus of claim 125, wherein the advertisement 
performance information includes on e or mor e of selection information and impression 
information for the on e or mor e advertisements. 

127. (Previously Presented) The apparatus of claim 125, wherein the document 
is a Web page identified by a URL. 

128. (Currently Amended) The apparatus of claim 125, wherein the one or more 
processors are configured to modify the initial advertisement performance information for an fee 
at least on e of the one or more advertisement[[s]] by: 
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selecting identifying an identified content concept associated with the at least one of the 
one or more to which the advertisementffsll corresponds ; and 

receiving content concept performance information associated with the content for the 
selected concept , the content performance information being computed based on performance of 
other advertisements that were presented with the document and correspond to the selected 
concept, associated with th e at l e ast on e of th e one or mor e advertisements. 

129. (Currently Amended) The apparatus of claim 125, wherein the one or more 
processors are configured to receive, for each content identified concept [[of]] for the document, 
the content concept performance information comprises determining, for each content identified 
concept for_[[of]] the document, content concept performance information using [[the]] 
document specific advertisement performance information for the identified advertisements at 
l e ast on e of the one or more advertisements associated with the content corresponding to the 
identified concept. 

130. (Currently Amended) The apparatus of claim 129, wherein the one or more 
processors are further configured to: 

determin e , for e ach content concept of the document, the at least one of the one or more 
advertisements associated with th e content concept by determinating]], for a content each 
identified concept [[of]] for the document, document specific advertisement performance 
information for a first advertisement and a second advertisement associated with the cont e nt 
concept ; and 

determine, for each identified cont e nt concept [[of]] for the document, content concept 
performance information using the document specific advertisement performance information 
for the at least one of the on e or mor e advertisements associated with the content concept by 
processing, for the content concept of the document, the advertisem e nt performance information 
for th e first advertisement and the second advertisement associated content corresponding to the 
identified concept. 
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131. (Currently Amended) The apparatus of claim 1 25, wherein the concept 
performance information for a concept includes one or more of selection information and 
impression information for advertisements presented with the document and corresponding to the 



132. (Currently Amended) The apparatus of claim 125, wherein the one or more 
processors are further configured to determine a confidence measure for the advertisement 
performance information , the confidence measure representing a confidence level for the 
advertisement performance information relative to other advertisement performance information . 



more processors are configured to determine the confidence measure for the advertisement 
performance information by determining a confidence measure for the advertisement 
performance information based on one or more of the age of data included in the advertisement 
performance information and the amount of the data included in the advertisement performance 
information. 

134. (Currently Amended) The apparatus of claim 125, wherein the at least one of the 



concept[[s]]. 



133. (Previously Presented) 



The apparatus of claim 132, wherein the one or 




advertisements. 



135. (Currently Amended) The apparatus of claim 125, wherein the at least one of the 
one or more advertisement[[s]] for which the initial advertisement performance information is 
modified is different from the forwarded at least one of the one or more advertisements. 
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136. (Currently Amended) The apparatus of claim 125, wherein the one or more 
processors are configured to forward, based on the modified advertisement performance 
information, [[the]] at least one of the one or more advertisements by: 

comparing the modified advertisement performance information for an advertisement to a 
threshold; 

determining that the modified advertisement performance information exceeds the 
threshold; and 

forwarding the advertisement based on the modified advertisement performance 
information exceeding the threshold . 

137. (Currently Amended) The apparatus of claim 1 25, wherein the one or more 
processors are configured to: 

identify the one or more content concepts [[of|] to which the document is relevant by 
identifying a first cont e nt concept and a second content concept [[of]] to which the document js 
relevant ; and 

determin e , for each content concept of the document, the at least one of the one or mor e 
adv e rtis e m e nts associated with the cont e nt concept by determine[[ing]] that one of th e one or 
more an_advertisement[[s]] is associated with both the associated with the first content concept 
and the second content concept [[of]] for the document. 

138. (Currently Amended) The apparatus of claim 125, wherein the one or more 
processors are configured to: 

receive the initial advertisement performance information for the one or more 
advertisements by receiving advertisement targeting information for the one or more 
advertisements; and 

receive the content concept performance information by receiving content concept 
targeting performance information representing an aggregate performance of advertisements 
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targeted according to the advertisement targeting information that were presented with the 
document based on the advertisement targeting information . 

139. (Currently Amended) The apparatus of claim 125, wherein the one or more 
processors are further configured to: 

identify a first advertisement of the one or more advertisement that does not have initial 
advertisement performance information; 

determine that at least one of the one or more content identified concepts [[of]] for the 
document associated with correspond to the first advertisement; 

receive content concept performance information for the at least one of the one or more 
content identified concepts associated with corresponding to the first advertisement; and 

determine, based on the received cont e nt concept information for the at least one of the 
on e or mor e cont e nt identified concepts associated with the first advertisement, estimated 
advertisement performance information for the first advertisement. 

140. (Currently Amended) The apparatus of claim 139, wherein the one or more 
processors are configured to determine the estimated advertisement performance information for 
the first advertisement by determining a weighted-sum of the content concept information for the 
at least one of the on e or more content identified concepts associated with corresponding to the 
first advertisement. 



141 . (Currently Amended) A storage device storing a computer program comprising 
one or more code segments that, when executed, cause at least one processor to: 

identify r eceive one or more advertisements that are available for presentation with a 
document ; 

receive initial advertisement performance information for the one or more 
advertisements , the advertisement performance information for each advertisement specifying a 
measure of performance computed based on previous presentations of the advertisement ; 
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identify one or more content concepts [[of all to which the document is relevant, concepts 
being identified based on content of the document ; 

receive, for each identified content concept [[of ]]for the document, content concept 
performance information representing an aggregate performance of advertisements that were 
presented with the document and corresponding to the concept ; 

d e termine, for each content concept of the document, at least one of the one or more 
adv e rtisements associated with th e content conc e pt; 

modify the initial advertisement performance information for at least one of the one or 
advertisement [s]] using the determined content concept performance information for 
th e content an identified concept associated with corresponding to the at least one of the one or 
mere-advertisement[[s]]; and 

forward, based on the modified advertisement performance information, at least one of 
the on e or mor e advertisements. 

142. (Currently Amended) The storage device of claim 141 , wherein the advertisement 
performance information includes one or more of selection information and impression 
information for th e on e or mor e advertisements. 

1 43 . (Previously Presented) The storage device of claim 141, wherein the 
document is a Web page identified by a URL. 

144. (Currently Amended) The storage device of claim 141 , wherein the one or more 
code segments that, when executed, cause the at least one processor to modify the initial 
advertisement performance information for an the at least on e of the one or more 
advertisement[[s]]comprises one or more code segments that, when executed, cause the at least 
one processor to: 

select identify a n identified content concept associated with the at least on e of the one or 
mere to which the advertisement's]] corresponds ; and 
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receive content concept performance information associated with the content for the 
selected concep t, the content performance information being computed based on performance of 
other advertisements that were presented with the document and correspond to the selected 
concept, associated with th e at least one of the one or more advertisements. 

145. (Currently Amended) The storage device of claim 141, wherein the one or more 
code segments that, when executed, cause the at least one processor to receive, for each cont e nt 
identified concept [[of]] for the document, the content concept performance information comprise 
one or more code segments that, when executed, cause the at least one processor to determine, 
for each content identified concept [[of ]] for the document, content concept performance 
information using [[the]] document specific advertisement performance information for the at 
least one of th e one or more advertisements associated with the content identified advertisements 
corresponding to the identified concept. 

146. (Currently Amended) The storage device of claim 145, wherein the one or more 
code segments that, when executed, cause the at least one processor to: 

d e t e rmin e , for each content concept of the document, the at least one of the one or mor e 
advertisements associated with the content concept comprise one or more code segments that, 
when executed, caus e th e at l e ast on e proc e ssor to determine, for a content each identified 
concept [[of]]for the document, document specific advertisement performance information for a 
first advertisement and a second advertisement associated with the content concept ; and 

determine, for each identified content concept [[of]] for the document, content concept 
performance information using the document specific advertisement performance information 
for the at least on e of the one or more adv e rtisements associated with the content concept 
compris e one or more code segments that, when executed, cause the at least one processor to 
process, for the cont e nt concept of the document, the adv e rtisement performance information for 
the first advertisement and the second advertisement associated content corresponding to the 
identified concept. 
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147. (Currently Amended) The storage device of claim 141 , wherein the concept 
performance information for a concept includes one or more of selection information and 
impression information for advertisements presented with the document and corresponding to the 
one or more concept[[s]]. 

148. (Currently Amended) The storage device of claim 141 , wherein the one or more 
code segments further comprise one or more code segments that, when executed, cause the at 
least one processor to determine a confidence measure for the advertisement performance 
informatio n, the confidence measure representing a confidence level for the advertisement 
performance information relative to other advertisement performance information . 

149. (Previously Presented) The storage device of claim 148, wherein the one or 
more code segments that, when executed, cause the at least one processor to determine the 
confidence measure for the advertisement performance information comprise one or more code 
segments that, when executed, cause the at least one processor to determine a confidence 
measure for the advertisement performance information based on one or more of the age of data 
included in the advertisement performance information and the amount of the data included in 
the advertisement performance information. 

1 50. (Currently Amended) The storage device of claim 141, wherein the at least one of 
the one or more advertisement[[s]] for which the initial advertisement performance information 
is modified is included with the same as the forwarded at least one of the one or more 
advertisements. 



151. (Currently Amended) The storage device of claim 141, wherein the at least one of 
th e on e or more advertisement[[s]] for which the initial advertisement performance information 
is modified is different from the forwarded at least one of the one or more advertisements. 
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1 52. (Currently Amended) The storage device of claim 141, wherein the one or more 
code segments that, when executed, cause the at least one processor to forward, based on the 
modified advertisement performance information, the at least one of the one or more 
advertisements comprise one or more code segments that, when executed, cause the at least one 
processor to; 

compare the modified advertisement performance information for an advertisement to a 
threshold; 

determine that the modified advertisement performance information exceeds the 
threshold; and 

forward the advertisement based on the modified advertisement performance information 
exceeding the threshold . 

153. (Currently Amended) The storage device of claim 141, wherein the one or more 
code segments that, when executed, cause the at least one processor to: 

identify the one or more content concepts f [of|"| to which the document is relevant 
comprise one or more code segments that, when executed, cause the at least one processor to 
identify a first cont e nt concept and a second content concept [[of]]towhich the document js 
relevant ; and 

determine, for each cont e nt concept of the document, th e at least one of the one or more 
advertisements associated with th e cont e nt concept comprise one or more code segments that, 



advertisement[[s]] is associated with both the associated with the first content concept and the 
second content concept [[of 11 for the document. 




determine that 




an 



1 54. (Currently Amended) The storage device of claim 141, wherein the one or more 
code segments that, when executed, cause the at least one processor to: 
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receive the initial advertisement performance information for the one or more 
advertisements comprise one or more code segments that, when executed, cause the at least one 
processor to receive advertisement targeting information for the one or more advertisements; and 

receive the content concept performance information comprise one or more code 
segments that, when executed, cause the at least one processor to receive content concept 
targeting performance information representing an aggregate performance of advertisements 
targeted according to the advertisement targeting information that were presented with the 
document based on the advertisement targeting information . 

155. (Currently Amended) The storage device of claim 141, wherein the one or more 
code segments further comprise one or more code segments that, when executed, cause the at 
least one processor to: 

identify a first advertisement of th e one or mor e advertisem e nt that does not have initial 
advertisement performance information; 

determine that at least one of the one or mor e content identified concepts [[of]] for the 
document associated with correspond to the first advertisement; 

receive cont e nt concept performance information for the at least one of the one or more 
content identified concepts associated with corresponding to the first advertisement; and 

determine, based on the received content concept information for the at least one of the 
on e or more cont e nt identified concepts associated with the first advertisement, estimated 
advertisement performance information for the first advertisement. 

1 56. (Currently Amended) The storage device of claim 1 55, wherein the one or more 
code segments that, when executed, cause the at least one processor to determine the estimated 
advertisement performance information for the first advertisement comprise one or more code 
segments that, when executed, cause the at least one processor to determine a weighted-sum of 
the content concept information for the at least one of the one or more content concepts 
associated with corresponding to the first advertisement. 



